Vehicle Activity Information System

ABSTRACT

Techniques are described for vehicle activity information collection and analysis. A vehicle activity information unit in a vehicle generates vehicle activity information including video data that is captured by interior and/or exterior camera(s) on the vehicle. The vehicle activity information can also include sensor data generated by an accelerometer, a compass, a temperature sensor, a Global Positioning System module, and/or other sensor(s). The vehicle activity information can also include audio data generated by at least one microphone. In some implementations, at least a portion of the vehicle activity information is collected during a period of time that includes an event (e.g., an accident). The information is stored in data storage with an association between the information and the event, and is processed to generate performance data associated with a driver of the vehicle. The performance data can be presented through a user interface to the driver or other(s).

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/912,921, filed on Mar. 6, 2018, entitled “VEHICLE ACTIVITYINFORMATION SYSTEM,” which is a continuation of U.S. patent applicationSer. No. 15/477,564, filed on Apr. 3, 2017, entitled “VEHICLE ACTIVITYINFORMATION SYSTEM,” which is a divisional application of U.S. patentapplication Ser. No. 14/105,564, filed on Dec. 13, 2013, entitled“VEHICLE ACTIVITY INFORMATION SYSTEM,” now U.S. Pat. No. 9,633,576,which claims priority under 35 U.S.C. 119(e) to U.S. Provisional PatentApplication Ser. No. 61/736,999, entitled “Vehicle Activity InformationSystem,” which was filed on Dec. 13, 2012, the disclosure of which areincorporated herein by reference in their entirety.

FIELD OF THE INVENTION

The disclosed embodiments relate to vehicular data acquisition. Thedisclosed embodiments also relate to real-time management of fleetvehicles.

BACKGROUND

Certain driver factors such as speeding, inattention, fatigue, andunfamiliarity with roads accounts for majority of all vehicular crashes.Driver error is ten times more likely to be the cause of truck-relatedaccidents as compared to other factors such as poor road conditions,weather, and mechanical malfunctions. As a means to reduce truck-relatedaccidents, greater attention needs to be focused on developing systemsfor monitoring at-risk driver behavior in motor vehicle fleets toimprove driver safety. Fleet operators incur losses as a result ofexcess fuel and maintenance costs, as well as losses due to inefficientmanagement of individual vehicles in the fleet as well as groups offleet vehicles such as those located in a specific geographic area.

Modern vehicles use a number of communication systems and/or networks,which could be utilized to collect driver and vehicular data. Each ofthese communication systems and/or networks may have a bus structurethat is open or proprietary. Each of these buses may also bespecifically designed to work in a vehicle or may be available as ageneral communication protocol. For example, the high-speed CAN buscarries information that is vital for vehicle operation or safety and isdelivered to various parts of the vehicle or system in substantiallyreal time.

Therefore, a need exists for an improved driver monitoring system thatcollects vehicular and driver data to improve driving behaviors.

SUMMARY

The following summary is provided to facilitate an understanding of someof the innovative features unique to the embodiments disclosed and isnot intended to be a full description. A full appreciation of thevarious aspects of the embodiments can be gained by taking the entirespecification, claims, drawings, and abstract as a whole.

It is, therefore, one aspect of the disclosed embodiments to provide forimproved vehicular data acquisition.

It is another aspect of the disclosed embodiments to provide formonitoring driver behavior.

It is a further aspect of the disclosed embodiments to provide forreal-time management of fleet vehicles.

The above and other aspects can be achieved as is now described. Thedisclosed apparatus, system, and method serve to modify a driver'sbehavior, reduce accident costs, and generate more revenue from acompany vehicle. Risky behavior that often leads to accidents, personalinjury, property damage, and loss of a driver's livelihood ishighlighted in the disclosed system. By focusing on a driver's unsafeactions, the disclosed system teaches a driver to correct unsafe drivingbehaviors. An employer or insurance company, for example, can access alldata captured before, during, and after the accident or event to assistwith finding fault. The disclosed vehicle activity information system isfully configurable at all times during installation of the system andduring use thereof. A plurality of integrated cameras provides constantvideo surveillance of the interior and exterior of a vehicle, thusworking simultaneously to capture a driver's actions in the vehicleinformation activity system.

A vehicle activity information system is disclosed. In an embodiment,the system includes a processor; a data bus coupled to the processor;and a non-transitory computer-usable tangible storage device storingcomputer program code, the compute program code comprising programinstructions executable by the processor. The computer programinstructions comprise of instructions to: collect driver and vehicularinformation; analyze the collected vehicular and driver information; andconfigure parameters for displaying the collected driver and vehicularparameters to improve driving behavior. In one embodiment, the vehicleand driver information and the parameters comprise at least one of:event details, observations, driver detail, sharing, download video,unsafe driving, stopping, speeding, driver behavior, collisions,equipment, scoring, map, location, coaching session, revise scoring,save coaching, no action, and fuel monitoring.

In another embodiment, the vehicle activity information system comprisesprogram instructions to review and score the collected and analyzedvehicular and driver information, wherein the collected and analyzedvehicular and driver information is reviewed by a supervisor of adriver; and program instructions to educate a driver based on improveddriving behavior based on the collected and analyzed vehicular anddriver information. In yet another embodiment, the vehicle activityinformation system comprises program instructions to automaticallytrigger collection of the vehicular and driver information, wherein atrigger comprises at least one of the vehicle running a red light,tailgating another vehicle or being tailgated by another vehicle,speeding as determined by a current speed limit based on a certainlocation as gathered by the system, g-force, manual operation, and thevehicle speeding at a predetermined rate. In an embodiment, the vehicleactivity information system comprises program instructions to collectvehicular and driver data from a smartphone, tablet, or a plurality ofintegrated cameras, wherein the plurality of integrated cameras providecontinuous video surveillance of an interior and an exterior of avehicle, wherein the program instructions further provide video clips ofvarying lengths, varying number video channels, and variable bit rate tooptimize storage of the video surveillance.

In one embodiment, the vehicle activity information system comprisesprogram instructions to: provide off-board storage, post analytics,report generation, and a user interface associated with customerretrieval of the collected and analyzed vehicular and driverinformation; create a report based on tracked vehicular and driverinformation parameters, wherein the report includes at least one of:driving trends, accident hot spots, risky driving behavior of thedriver, vehicle route, and site performance; and remotely access thecollected vehicular and driver information and the parameters. In otherembodiments, the vehicle activity information system comprises programinstructions to: automatically and wirelessly upload collected vehicularand driver information to the processor; and create a geofence for afleet group, wherein the geofence comprises at least one person orentity for email notification of an event.

A vehicle activity information method is also disclosed. The methodcomprises: collecting driver and vehicular information; analyzing thecollected vehicular and driver information; and configuring parametersfor displaying the collected driver and vehicular parameters to improvedriving behavior. In one embodiment, the vehicle and driver informationand the parameters comprise at least one of: event details,observations, driver detail, sharing, download video, unsafe driving,stopping, speeding, driver behavior, collisions, equipment, scoring,map, location, coaching session, revise scoring, save coaching, noaction, and fuel monitoring. In another embodiment, the method comprisesreviewing and scoring the collected and analyzed vehicular and driverinformation, wherein the collected and analyzed vehicular and driverinformation is reviewed by a supervisor of a driver; and educating adriver based on improved driving behavior based on the collected andanalyzed vehicular and driver information. In another embodiment, themethod comprises automatically triggering collection of the vehicularand driver information, wherein a trigger comprises at least one of thevehicle running a red light, tailgating another vehicle or beingtailgated by another vehicle, speeding as determined by a current speedlimit based on a certain location as gathered by the system, g-force,manual operation, and the vehicle speeding at a predetermined rate.

In an embodiment, the vehicle activity information method furthercomprises collecting vehicular and driver data from a smartphone,tablet, or a plurality of integrated cameras, wherein the plurality ofintegrated cameras provide continuous video surveillance of an interiorand an exterior of a vehicle, wherein the program instructions furtherprovide video clips of varying lengths, varying number video channels,and variable bit rate to optimize storage of the video surveillance. Inanother embodiment, the method discloses providing off-board storage,post analytics, report generation, and a user interface associated withcustomer retrieval of the collected and analyzed vehicular and driverinformation; creating a report based on tracked vehicular and driverinformation parameters, wherein the report includes at least one of:driving trends, accident hot spots, risky driving behavior of thedriver, vehicle route, and site performance; and remotely accessing thecollected vehicular and driver information and the parameters. In yetanother embodiment, the method comprises automatically and wirelesslyuploading collected vehicular and driver information to the processor;and creating a geofence for a fleet group, wherein the geofencecomprises at least one person or entity for email notification of anevent.

A vehicle activity information apparatus is disclosed. The apparatuscomprises an enclosure; a cable extending from the enclosure; and a datacollecting device integrated within the enclosure. In an embodiment, thedata collecting device comprises at least one of: a camera, a pluralityof cameras, a forward view camera, a cabin view camera module, and a panadjustable camera. In another embodiment, the apparatus comprises anantennae extending from the enclosure, a speaker, a microphone, an eventbutton, a status light emitting diode, and an infrared light emittingdiode. In one embodiment, the cable extends from the enclosure via aremovable connector, wherein the cable comprises connections on a distalend of the cable, wherein the connections comprise CAN/J1939/ODB2 andpower, RS-232 expansion, discretes, and external unit connections,wherein the external unit connections comprise at least one externalcamera unit with integrated audio, video, and power. In otherembodiments, the apparatus comprises an internal GPS unit, local storageaccess, and a USB port integrated within the enclosure. In yet anotherembodiment, the apparatus comprises a wireless data collection andtransmission device integrated within the enclosure for transmittingcollected vehicular and river data.

BRIEF DESCRIPTION OF THE FIGURES

The accompanying figures, in which like reference numerals refer toidentical or functionally-similar elements throughout the separate viewsand which are incorporated in and form a part of the specification,further illustrate the embodiments and, together with the detaileddescription, serve to explain the embodiments disclosed herein.

FIG. 1 illustrates an exemplary block diagram of an exemplarydata-processing apparatus, in accordance with the disclosed embodiments;

FIG. 2 illustrates an exemplary schematic view of an exemplary softwaresystem including an operating system, application software, and a userinterface, in accordance with the disclosed embodiments;

FIG. 3 illustrates an exemplary block diagram of the vehicle activityinformation system's safety cycle, according to a preferred embodiment;

FIG. 4 illustrates an exemplary block diagram of the vehicle activityinformation system gathering and processing vehicle data, in accordancewith the embodiments;

FIG. 5 illustrates an exemplary flow chart of operations illustrating amethod for gathering and processing safety information, in accordancewith the embodiments;

FIG. 6 illustrates an exemplary block diagram of operations illustratinga system for gathering and processing safety information, in accordancewith the embodiments;

FIG. 7 illustrates an exemplary block diagram of the functional hardwareof a vehicle activity information system unit, in accordance with theembodiments;

FIGS. 8A-8C illustrate an exemplary pictorial illustration of a vehicleactivity information system unit apparatus, in accordance with theembodiments; and

FIG. 9 illustrates an exemplary graphical user interface (GUI) fordisplay of driver safety information gathered from the vehicle activityinformation system, in accordance with the disclosed embodiments.

DETAILED DESCRIPTION

The particular values and configurations discussed in these non-limitingexamples can be varied and are cited merely to illustrate at least oneembodiment and are not intended to limit the scope thereof.

The embodiments will now be described more fully hereinafter withreference to the accompanying drawings, in which illustrativeembodiments of the invention are shown. The embodiments disclosed hereincan be embodied in many different forms and should not be construed aslimited to the embodiments set forth herein; rather, these embodimentsare provided so that this disclosure will be thorough and complete, andwill fully convey the scope of the invention to those skilled in theart. Like numbers refer to like elements throughout. As used herein, theterm “and/or” includes any and all combinations of one or more of theassociated listed items.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an,” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, elements,components, and/or groups thereof.

Unless otherwise defined, all terms (including technical and scientificterms) used herein have the same meaning as commonly understood by oneof ordinary skill in the art to which this invention belongs. It will befurther understood that terms, such as those defined in commonly useddictionaries, should be interpreted as having a meaning that isconsistent with their meaning in the context of the relevant art andwill not be interpreted in an idealized or overly formal sense unlessexpressly so defined herein.

As will be appreciated by one skilled in the art, one or more of thedisclosed embodiments can be embodied as a method, system, or computerprogram usable medium or computer program product. Accordingly, thedisclosed embodiments can in some instances that take the form of anentire hardware embodiment, an entire software embodiment or anembodiment combining software and hardware aspects all generallyreferred to herein as a “module”. Furthermore, the disclosed embodimentsmay take the form of a non-transitory computer usable or readablemedium, computer program product, a computer-readable tangible storagedevice storing computer program code, said computer program codecomprising program instructions executable by said processor on acomputer-usable storage medium having computer-usable program codeembodied in the medium. Any suitable computer readable medium may beutilized including hard disks, USB Flash Drives, DVDs, CD-ROMs, opticalstorage devices, magnetic storage devices, etc.

The computer program code may execute entirely on the user's computer,partly on the user's computer, as a stand-alone software package, partlyon the user's computer and partly on a remote computer or entirely onthe remote computer. In the latter scenario, the remote computer may beconnected to a user's computer through a local area network (LAN) or awide area network (WAN), wireless data network e.g., WiFi, Wimax,802.xx, and cellular network or the connection may be made to anexternal computer via most third party supported networks (for example,through the Internet using an Internet Service Provider).

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner such that the instructions stored in the computer-readable memoryproduce an article of manufacture including instruction means whichimplement the function/act specified in the block or blocks. Thecomputer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide steps for implementing the functions/acts specified inthe block or blocks.

FIG. 1 illustrates a block diagram of a sample data-processing apparatus100, which can be utilized for an improved vehicular activityinformation system, method, and apparatus. Data-processing apparatus 100represents one of many possible data-processing and/or computingdevices, which can be utilized in accordance with the disclosedembodiments. It can be appreciated that data-processing apparatus 100and its components are presented for generally illustrative purposesonly and do not constitute limiting features of the disclosedembodiments.

As depicted in FIG. 1, a memory 105, a mass storage 107 (e.g., harddisk), a processor (CPU) 110, a Read-Only Memory (ROM) 115, and aRandom-Access Memory (RAM) 120 are generally connected to a system bus125 of data-processing apparatus 100. Memory 105 can be implemented as aROM, RAM, a combination thereof, or simply a general memory unit. Module111 includes software module in the form of routines and/or subroutinesfor carrying out features of the present invention and can beadditionally stored within memory 105 and then retrieved and processedvia processor 110 to perform a particular task. A user input device 140,such as a keyboard, mouse, or another pointing device, can be connectedto PCI (Peripheral Component Interconnect) bus 145.

Data-process apparatus 100 can thus include CPU 110, ROM 115, and RAM120, which are also coupled to a PCI (Peripheral Component Interconnect)local bus 145 of data-processing apparatus 100 through PCI Host Bridge135. The PCI Host Bridge 135 can provide a low latency path throughwhich processor 110 may directly access PCI devices mapped anywherewithin bus memory and/or input/output (I/O) address spaces. PCI HostBridge 135 can also provide a high bandwidth path for allowing PCIdevices to directly access RAM 120.

A communications adapter 155 attaches to an eSata/Sata/USB/SD Cardinterface 150. An expansion bus-bridge 170 can also be attached to PCIlocal bus 145. The communications adapter 155 can be utilized forconnecting data-processing apparatus 100 to a network 165. SCSI 150 canbe utilized to control high-speed SCSI disk drive 160. An expansionbus-bridge 170 could be utilized for coupling an additional bus asneeded. Note that PCI local bus 145 can further be connected to amonitor 130, which functions as a display (e.g., a video monitor) fordisplaying data and information for a user and also for interactivelydisplaying a graphical user interface (GUI) 185. A user actuates theappropriate keys on the GUI 185 to select data file options. Note thatthe term “GUI” generally refers to a type of environment that representsprograms, files, options and so forth by means of graphically displayedicons, menus, and dialog boxes on a computer monitor screen.

The embodiments described herein can be implemented in the context of ahost operating system and one or more modules. Such modules mayconstitute hardware modules such as, for example, electronic componentsof a computer system. Such modules may also constitute software modules.In the computer programming arts, a software “module” can be typicallyimplemented as a collection of routines and data structures thatperforms particular tasks or implements a particular abstract data type.

Software modules generally can include instruction media storable withina memory location of an image processing apparatus and are typicallycomposed of two parts. First, a software module may list the constants,data types, variable, routines and the like that can be accessed byother modules or routines. Second, a software module can be configuredas an implementation, which can be private (i.e., accessible perhapsonly to the module), and that contains the source code that actuallyimplements the routines or subroutines upon which the module is based.The term “module” as utilized herein can therefore generally refer tosoftware modules or implementations thereof. Such modules can beutilized separately or together to form a program product that can beimplemented through signal-bearing media, including transmission mediaand/or recordable media. An example of such a module that can embodyfeatures of the present invention is a vehicular activity informationmodule 204, as depicted in FIG. 2.

FIG. 2 illustrates a schematic view of a software system 200 includingan operating system, application software, and a user interface forcarrying out the disclosed embodiments. Computer software system 200directs the operation of the data-processing system 100 depicted inFIG. 1. Software application 202, stored in main memory 105 and on massstorage 107, includes a kernel or operating system 201 and a shell orinterface 203. One or more application programs, such as softwareapplication 202, may be “loaded” (i.e., transferred from mass storage107 into the main memory 105) for execution by the data-processingsystem 100. The data-processing system 100 receives user commands anddata through the interface 203, as shown in FIG. 2. The user's commandinput may then be acted upon by the data-processing system 100 inaccordance with instructions from operating module 201 and/orapplication module 202.

The interface 203 also serves to collect and analyze vehicle activityinformation, whereupon the user may supply additional inputs orterminate the session. In an embodiment, operating system 201 andinterface 203 can be implemented in the context of a “Windows” system.It can be appreciated, of course, that other types of systems arepossible. For example, rather than a traditional “Windows” system, otheroperation systems such as, for example, Linux may also be employed withrespect to operating system 201 and interface 203. The softwareapplication 202 can include a vehicle activity information module. Thesoftware application 202 can also be configured to communicate with theinterface 203 and various components and other modules and features asdescribed herein.

Note that the term module as utilized herein may refer to a collectionof routines and data structures that perform a particular task orimplements a particular abstract data type. Modules may be composed oftwo parts: an interface, which lists the constants, data types,variable, and routines that can be accessed by other modules orroutines, and an implementation, which is typically private (accessibleonly to that module) and which includes source code that actuallyimplements the routines in the module. The term module may also simplyrefer to an application such as a computer program design to assist inthe performance of a specific task such as word processing, accounting,inventory management, music program scheduling, etc.

Generally, program modules include routines, programs, objects,components, data structures, etc., that perform particular tasks orimplement particular abstract data types. Moreover, those skilled in theart will appreciate that the disclosed method and system may bepracticed with other computer system configurations such as, forexample, hand-held devices, multi-processor systems,microprocessor-based or programmable consumer electronics, networkedPCs, minicomputers, mainframe computers, and the like.

FIG. 3 illustrates an exemplary bock diagram 300 of the vehicle activityinformation system's safety cycle, according to a preferred embodiment.The vehicle activity information system also includes the off-boardstorage, post analytics, report generation, and the user interfaceassociated with the customer retrieval of the desired data. Vehiclemonitoring system captures activity of a driver and vehicle and performsvideo analytics based on the captured activity 301. The capturedactivity is then automatically and wirelessly uploaded to the system atthe end of a shift 302. The captured activity is then reviewed andscored by the system, an observation center, reviewing software, orhuman interpretation 303. Custom grading defines how a driver is scoredbased on recorded driving activity. System users (e.g., supervisors)evaluate events for driver's coaching needs, enhanced productivity andoperations, vehicle accident, and other operational issues 304. Thedrivers are then educated based on the system's analysis of driving andvehicle behavior 305. An integrated filer coaches the driver's behaviorbased on custom-set guidelines and parameters. Parameters are set basedon needs of the customer. Advanced event data in disclosed embodimentsprovide information based on certain parameters (e.g., vehicle speed,shock, driver, vehicle location, cause of trigger, etc.). Theseparameters are shown in a high-quality video gathered from the pluralityof cameras within a vehicle. Disclosed embodiments provide detailedreporting based on the tracked parameters. The reporting displaystrends, accident hot spots, and compares site performance, for example.The riskiest driving behaviors, vehicles, and routes are easilyidentified.

FIG. 4 illustrates an exemplary block diagram 400 of the vehicleactivity information system gathering and processing vehicle data, inaccordance with the embodiments. Vehicle and driver information isgathered via: a digital sensor and CAN/J1939/ODB2 interface asillustrated in block 401, an on-board camera, as illustrated in block402; and a GPS/built in magnetometer, as illustrated in block 403. Thegathered vehicle and driver information is stored and analyzed by thesystem, as illustrated in block 404. The analyzed information goes inseparate paths. In the first path, the analyzed vehicle and driverinformation is categorized quickly as illustrated in block 405. In block406, a new file is created for this categorized vehicle and driverinformation. A user is then notified of the categorized vehicle anddriver information, as illustrated in block 407. The user could be anowner or a supervisor of a company, for example. Finally, the user couldcommunicate the analyzed and categorized vehicle and driver informationto another user, a supervisor, or the driver, as illustrated in block408. The communication could include the analyzed vehicle and driverinformation, along with coaching suggestions on improvements to drivingbehavior based on the analyzed and categorized information.

In the second path, the stored and analyzed driver information fromblock 404 could be further analyzed to identify areas of driverbehavior, as illustrated in block 409. The areas of driver behavior canthen be stored in a database within the system, as illustrated in block410. A sampling can be taken of the additionally analyzed information,as illustrated in block 411, to gather information about a particulardriver or vehicle, or learn about trouble spots that need furtherattention from a supervisor. As illustrated in block 412, a score can beapplied to the identified areas of driver behavior to further assistwith coaching to improve driver behavior. A driver trend report canthereafter be created as illustrated in block 413.

FIG. 5 illustrates an exemplary flow chart 500 of operationsillustrating a method for gathering and processing safety information,in accordance with the embodiments. Vehicle and driver information isgathered from vehicle activity information system units installed withvehicles 503. The information is then routed from a tablet/smartphonethrough a cellular network 506 via the internet 501 to a NMS with an alldrive safe server module 502. Vehicle driver information from vehicle503 can also be routed via a tablet/smartphone via a WiFi/wireless linkto a NMS with basic FTP/SCP daemon 504. The API and data representationis REST compliant to allow direct use by standard web technologies. Thesystem runs a modern and complete operating system (Linux) in anembedded server that constantly monitors and records in a standard JSONformat the vehicle telemetry, onboard vehicle computer data, and recordsexternal events. The embedded server constantly records video and audiofrom at least 1-8 camera(s). The system embodies various cameraconfigurations. In one embodiment, two fixed cameras are utilized in thesystem in addition to a plurality (e.g., 2 or more up to 6 preferably,or more cameras added as needed) of either fixed, accessory, and/orbuilt-in cameras.

The system performs real time video analysis to monitor drivers andvehicles behavior. Vehicle activity information system monitors speedthrough its GPS, the J1939 interface for diesel engines, and the OBD2interface for gas engines, a set of four users configurable externaltrigger as well as. Any of these events can be configured to output alog of the data, create a jpeg picture, and/or capture a video. Each ofthe video camera and associated microphone can be either enabled ordisabled depending on specific needs to maximize on-board storage.Certain activities of the driver, activities of the vehicle, and variousroad conditions trigger automatic operation of unit and system. Suchtriggers can include, for example, vehicle running a red light,tailgating another vehicle or being tailgated by another vehicle,speeding as determined by a current speed limit based on a certainlocation as gathered by system, g-force, manual operation, and thevehicle speeding at predetermined rate.

FIG. 6 illustrates an exemplary block diagram 600 of operationsillustrating a system for gathering and processing safety information,in accordance with the embodiments. The illustrated system comprises anetwork management system (“NMS”) 610, a computing device 620, and avehicle activity information system unit apparatus 630. NMS furthercomprises a video review module 611, a configuration and remotemanagement module 612, a fuel monitoring module 613, an emergency andtwo way communication server module 614, a geofencing module 615, and areal-time vehicle monitoring module server 616. Computing device 620comprises at least one of a: tablet, smartphone, Android® device,iPhone®, or iPad®. Vehicle activity information system unit apparatus630 comprises: a real-time vehicle monitoring module client 631, asecure web server 632 (e.g., web service API, Apple® Live streaming), anemergency two-way communication client module 633, and a media file andlog file module with SCP/FTP client 634. SCP/FTP client 634 interactswith USB driver 643. The real-time vehicle monitoring module client 631interacts with a data logging module 635. Data logging module 635interacts with serial port driver 642. The data logging module 635 caninclude an accelerometer, and a speed and user defined external triggersmonitoring module with TCA. Data logging module interacts with anencoder, system, events, and alarms configuration 636. Encoder 636interacts with CAN driver (CAN/J1939/ODB2) 641. An RTSP/RTP server 637interacts with network driver G/N 644 through a LINUX operating platform640. A vehicle activity information system redundant software updatemodule 638 is also included in vehicle activity information unitapparatus 630. Finally, audio/video encoder and mixing module 639interacts with camera driver 645 through the LINUX operating platform.

FIG. 7 illustrates an exemplary block diagram 700 of the functionalhardware of a vehicle activity information apparatus, in accordance withthe embodiments. The vehicle activity information apparatus comprises asystem processor 701 and either a one piece enclosure or a two pieceenclosure. The system processor 701 comprises an ARM Core 702 and a DSPCore 703, a video compression engine 704, an A/V Interface 705, a SDinterface 706, a CAN interface 707, a low speed serial interface 708, amemory interface 709, UART 710, USB 711, and a discrete I/O 712. A localevent button 713 and an additional I/O 714 interact with the discreteI/O 712.

The system processor 701 interacts with external cameraunits/microphones 715 through audio, video, and a power source 716. Theaudio/video/power source 716 interacts with a multi-channel audio/videodecoder 717 through the system processor 701. The decoder 717 interpretsdata from internal cameras 718, both the forward view camera 719 and thecabin camera 720. Data collected from a cab microphone 721, speaker 722,and local storage (e.g., SD card, drives) 723 is processed via systemprocesser 701. The system is provided with power through system power724 via a CAN/J1939/ODB2 interface 725 and a can transceiver 726 thatinteracts with system processor 701.

The antenna 727 interacts with system processor 701 via an internalWiFi/wireless Module 728 and 3G module 729 for wireless datatransmission and receipt. Also, interacting with system processor 701are local port 730, system expansion 731, GPS module 732, SDRAM/Flash733, a XYZ accelerator 734, real time clock 735, temperature sensor 736,and digital compass 737.

FIG. 8A illustrates an exemplary front plan view 800 of a vehicleactivity information apparatus enclosure 801, in accordance with theembodiments. The front plan view 800 illustrates an enclosure 801 withan integrated antenna 802 and removable connector 803 with tamperresistant screws 804. The removable connector 803 comprises a cable 805extending therefrom with various connections located on the cable's 805distal end. The connections comprise: CAN/J1939/ODB2 and Power 806,RS-232 Expansion 807, Discretes 808, and External Unit Connections 809.The External Unit Camera Unit Connections 809 comprises at least oneExternal Camera Unit 810 with integrated audio/video/power. Theenclosure 801 further comprises a speaker 811, microphone 812, eventbutton 813, status LEDs 814, IR LEDs 815, and a cabin view camera module816 that is pan adjustable.

FIG. 8B illustrates an exemplary side plan view 840 of a vehicleactivity information system apparatus enclosure 841, in accordance withthe embodiments. The side plan view 840 illustrates an enclosure 841with an integrated, adjustable antenna 842 and removable connector 843.The removable connector 843 has a cable 845 extending therefrom. Thefront portion 861 of the enclosure 841 further comprises a forward viewcamera 846, internal GPS unit 847, an adjustable mounting bracket 848with an associated adhesive pad 849, and a tamper-proof tilt lock 850.The rear portion 871 of the enclosure 841 comprises a local storagedevice access with a secure tamper proof door 851 and a cabin viewcamera module 852.

FIG. 8C illustrates an exemplary bottom plan view 880 of a vehicleactivity information apparatus enclosure 881, in accordance with theembodiments. The enclosure 881 comprises an antenna 882, vents 883, abracket 884, a local USB port 885, a cabin view camera module 886, and aforward view camera module 887.

FIG. 9 illustrates a pictorial illustration 900 of an exemplarygraphical user interface (GUI) for display of driver safety informationgathered from the vehicle activity information system, in accordancewith the embodiments. Information and data gathered and processed in thedisclosed vehicle activity information systems securely accessed througha web-based interface. A wide variety of parameters are viewed throughthe interface. A user can select displayed events or select particularparameters for viewing on the interface. For example, a supervisor of acompany with a fleet of vehicles wants to view a vehicle's speed andlocation. Therefore, a supervisor with secure access to the system's GUImay filter the parameters to view only speed and location of particularvehicles in the fleet.

The GUI includes various selectable options for viewing. Options forviewing include: Event details 901, Observations 902, Driver Detail 903,Sharing 904, and Download Video 905, etc. Categories of driving eventsfor a specific vehicle can be filtered according to: Unsafe Driving 906,Stopping/Speeding 907, Driver Behavior 908, Collision 909, Equipment910, etc. Each category of driving events 906, 907, 908, 909, and 910has expandable filters included under each tab as illustrated in FIG. 9.Users have the option to change views of vehicle and driver data withinthe GUI. Possible view selections include: Scoring 911, Map/Location912, Coaching Session 913, Go Back 914, Revise Scoring 915, SaveCoaching 916, and No Action 917, etc. It is understood that various GUIviews can be incorporated into the vehicle activity information system.

SECURE REMOTE CONFIGURATION: Vehicle activity information systemuniquely runs SSH client and daemon to allow the user to remote securelylog into the device remotely to change the configuration or downloadvideo and/or audio clips. It can be remotely configured to changeconfiguration parameter, specific event trigger on the fly, and downloadmedia files or log files. Using the SSH client to automatically log onthe server, clips that have been tagged with events are transferred. Thedisclosed apparatus is a remotely manageable device that can be remotelyconfigured to change configuration parameter, specific event trigger onthe fly, and download video.

WiFi AND/OR WIRELESS CAMERA MONITORING: When the system is installed,the system is capable of sending video over WiFi and/or wireless toposition the camera with a simple laptop and no external monitors areneed.

SECURE REMOTE SOFTWARE UPDATE AND DIAGNOSTICS: When the units innetworks communication range, it can be log onto through IP networks torun diagnostics.

ENCLOSURE DESIGN: The disclosed apparatus features a ruggedized designfor industrial deployment. It is designed to have water, dust, and shockresistant common to industrial environment.

REDUNDANT SOFTWARE: The system includes dual redundant program copy thatcan survive power failures in middle of a software updates. The softwarealso self-monitors and reports when the system is not functioningproperly. Memory fault protection is included, thus rendering itresilient to software fault and failures. Should the disclosed systembecome instable as a whole, system triggers the watchdog that willrestart the system in a known state.

DATA USAGE: The disclosed embodiments provide for video clips of varyinglengths, varying number video channels, and variable bit rate tooptimize the storage, flash card, hard drive, and/or data plan usage andminimize cost.

UNIQUE VIDEO AND AUDIO ENCODING TECHNOLOGY: While there are few systemthat use H264 base profile to record video onboard of a vehicles,vehicle activity information system embodiments uniquely encodes videowith H264 with Main Profile, High Profile and it can also uniquelyleverage the use of B-frames for extra compression. This uniquecharacteristic gives up to 30% extra compression at the same bitrate orup to 30% better quality at the same bitrate. It uniquely encodes audiousing an AAC codec to give better audio quality at same bitrate orbetter compression at the same quality. Video and audio extra claritytranslate directly into an increase of positive identification ofvehicles, licenses plates, driver voices for legal or court purposes.These audio and video codec are not used in other system because theyare not able to fit in power and size footprint requirement of thisapplication. Vehicle activity information system is the first system toachieve this level performance, feature set, and encoding density inthis footprint.

TABLET/SMARTPHONE INTEGRATION: Vehicle activity information systemprovides a framework to integrate and communicate, display and managewith modern smartphone and tablet application such as Android® Apps, andApple® IOS apps. The communication can be through Internet Protocol (IP)or USB. The secure web server serves all vehicle computer telemetry dataover udp and/or tcp and video over RTP and/or Apple® Live streaming forseamless integration with Android® and Apple® IOS devices as directclient. These features are unique and have never been part of avehicle's computer.

REMOTE NETWORK MANAGEMENT: Each of the vehicle activity informationsystem apparatuses functions as a Network Element and can be in manageor un-manage state. It is a remotely manageable device that can beremotely configured to change configuration parameter, specific eventtrigger on the fly, and download video. It acts as a network element andas notification system. The network manager displays the Network Elementon a map for tracking purpose.

EMERGENCY and TWO-WAY COMMUNICATION: In case of an accident where thedriver and/or vehicle are incapacitated, the system will broadcast itslocation using the GPS and video (previously recorded and live) from thecrash scene. This information can be forward directly to local authorityor 9-1-1 to get help there as quickly as possible. Also, NMS (NetworkManagement System) can also forward crash site information to all otherfleet vehicles close in range to provide direct help and set a route ontheir onboard computer (or using the onboard system speaker to readdirection to driver directly) to get there in minimum amount of time.The manager or the driver can use the same system to dispatch a voicecall.

REAL-TIME VEHICLE MONITORING AND GEOFENCING MODULE: Driver behaviorsoftware and geofencing are integrated together in the disclosedembodiments. This unique NMS is an object oriented integrated systemthat allows the fleet manager to draw geofence object on the map. Thefleet manager creates fleet groups and adds each of the network elements(“NE”). The fleet manager further creates objects for each person orentity that need to get notified through emails. These fleet groups canbe associated to the geofence object and possible events with a set ofrules control by a priority. Each rule can be exclusive ornon-exclusive. It also has basic logical operation such as and, or, xor,xand. These rules can get triggered by the geofence or by the vehicleactivity information system. For example, in the rental car industry, aset of rules can be created. If Avis® Rental car is in Houston_GeoFenceand speeding email HoustonAvisManager with a report including drivername, license number, location, picture, and video files. If truck is ondelivery route and has been stopped for 2 hours, email manager. If truckhas an accident within west coast geofence, a high priority email issent to west_coast_manager with location and a message to call him oncell phone.

FUEL MONITORING MODULE: Vehicle activity information systemsembodiments' unique fuel monitoring module is independent of fueltechnology. It works with CNG/LNG and diesel fuels. The systemcontinuously monitors fuel usage through J1939 interface and OBD2interface it will read MPG when it's available. It can infer data whenMPG is not available through throttle position, break usage,acceleration and tire pressure, but it needs to be calibrated to producenon-relative numbers to properly estimate fuel cost. It generates reportby brand and model of vehicle to compare relative efficiency. It canestablish a fuel consumption baseline and compare differentdriver/vehicle pairs; it will propose optimum driver/vehicle combinationbased on the data that has been accumulated over time. It will also rankdriver, vehicle, and driver/vehicle pair based on measured routes. Thevehicle with the lowest performance is noted in the system.

Current computer and video systems do not perform continuous on-boardrecording and extended storage (e.g. weeks) of multi-channel audio,video, and related vehicle environmental data while simultaneouslyanalyzing the data to determine which subset(s) should be wirelesslytransmitted. This approach allows for a significant reduction in theamount of transmitted data, and associated cost, while insuring otherpotentially event pertinent data is not lost and can be retrieved laterif further clarification is required. Current systems do not access andintegrate additional vehicle information available on the CAN/J1939/ODB2interface to perform further vehicle status and event processing.Optimal partitioning of on-board vs. off-board analytical processingload is also not performed by existing systems. The present inventionutilizes multiple cameras and other sensing elements to detect eventssuch as accidents. In providing information as to the circumstancesurrounding the event, the system acts as an aide in determiningresponsibility of the event.

Additionally, the system uses a range of data sources to identify areasof driver behavior that need correction and assist in driver behaviormodification. A statistical indication of vehicle performance is alsoobtained to allow for early identification of problem areas that couldresult in extended down time or above average operating costs. Thiscombination of features and abilities ultimately results in saving userstime and money in operation of their vehicle fleets. Another object ofthe present invention is integration with other vehicle systems via astandard bus interface to obtain further diagnostics, event, andprocessing data. Another object of the present invention is thecapability of in-field software updates to maintain optimal systemperformance with limited effort. Another object of the present inventionis the inclusion of an additional processing element specificallytargeted and effective at execution of advanced algorithms. Anotherobject of the invention is the ability to provide two way communicationswith the vehicle occupants. Another object of the invention is theability to perform local (e.g., Wi-Fi) and longer range (e.g., cellular)communication to address different market segments.

The events are stored on the server categorically and by criticality toallow for efficient review based on the amount of administrator limeavailable. Instant notification of the occurrence of highly criticalevents may be routed to pre-selected company individuals along with apreselected set of event data and/or event description. The systemrecords audio as well as video. The system has the ability to determineand improve driver efficiency based on time in route, time at station,the amount of time the vehicle is not active during the day, andoperational efficiency related to driver behavior patterns such as undueacceleration. Individual performance can be rated against other driversin the fleet.

The sampling and analysis is statistical based to avoid false detection.In this area, the reports are driver “trends” not a list of events theadministrator has to analyze to get a trend. The system also has theability to analyze the quality of the audio/video inputs and othergeneral system diagnostics and notification of the administrator as tothe nature of the problem. CAN/J1939/ODB2 interface uses its data tohelp determine the vehicle performance and as additional event data. Forexample, the driver's foot was still on the gas when the crash occurred,you can see on the video the car was swerving into the lane well beforethe driver hit the brake, etc. The reliability of the vehicle locationdetermination is improved by using the last known good GPS coordinatesor using closest cellular base station GPS coordinates, speedinformation from the CAN/J1939/ODB2, and the built in magnetometer(compass). Useful in rural, urban or cloudy environments where GPSsatellite LOS is blocked by buildings, trees or other object.

In addition to event data, continuous storage of relevant data for postevent retrieval in cases where the pre-selected trigger event datasetwas not adequate 10 fully determine the event circumstances. Ease ofsystem scalability of audio and video inputs, from 1 to 16, without amajor system redesign. Backup method for location determination based onlast known valid GPS location, truck speed (via the CAN/J1939/ODB2interface) and direction based on a built in electronic compass for usewhen the GPS signal is lost in urban environments. Integration with theUSB port allows for alignment for installation and local download ofevent data from the local storage (e.g., SD card) without having toremove the local storage. Pan adjustable unit cameras to allow for awider range of windshield mounting/unit placement. Dedicated DSP foradvanced algorithm processing that is not involved with standard DVRfunctions, communications, and low level diagnostics. CAN/J1939/ODB2interface to obtain vehicular data not easily gained by other means foruse in determining event circumstances, driver behavior, driverperformance, and other functions.

The disclosed system detects when a vehicle has run a stop sign orstoplight. Detection of video degradation due to tampering orenvironmental factors. The ability to detect when the video is dead isbuilt in. An algorithmic approach can be implemented that detects whensomething is smeared on the lens such as, mud, grease, etc. Thevideo-based vehicle proximity detection assesses whether: the driver isfollowing too close for the given speed, the driver is travelling intoan occupied lane, whether the driver is looking where he is going mostof the time, whether a driver's eyes are closed or open, and whether adriver's head is tilting down. The onboard system can be used to detectwhen a face changed then send the image back to the server where furtherface detection can be performed. This split approach keeps from havingthe entire face database on the truck unit of continuously storingpictures of the driver's face. This makes sure whoever is driving thetruck is the one that should be driving. Lane departure, erraticdriving, driving to close to the edge of the lane or road are alsodetected via the disclosed embodiments.

The intelligent threshold and complex event detection feature helpsdetection of low speed collisions with stationary objects. Some eventsare a combination of inputs that cannot be entered into a simpleax+by>Th formula. The system can use adaptive boosting methods(adaBoost) to detect these more complicated situations which couldotherwise go undetected.

Additional system features: enclosure can either comprise a singleenclosure or dual enclosure; more audio/video streams; video resolutionwill be changed to D1; on-board GPS module and magnetometer; small formfactor; system will spilt into two devices (window unit & under dashunit); separate data and program memories; CAN/J1939/ODB2 interface;expansion feature through RS232, and other digital inputs and outputs.Hardware requirements: DM8147 Soc from Texas Instruments as mainprocessing unit of vehicle activity information system 3.0; Total 512MB/1 GB DDR3 SDRAM, 512 MB NAND flash for program storage; six ExternalA/V stream support; video decoder to convert analog video signals todigital video data (TVP5158); two on-board NTSC camera modules; localCVBS video display output, video output selection switch; Audio:microphone and speaker will be provided to have bidirectional audiocommunication; Event Button: Button to activate any event by driver orany other user; LED: Three LED for indication; IR LED: To support nightvision inside truck cabin; External Modules: UART based GPS module, USBbased WiFi/wireless and Digital Compass; Data storage: local storagesupport; USB drive, eSata/Sata drive, Silicon ID chip; RS232 port; CANtransceiver to support CAN/J1939/ODB2; +12 VDC shall be available onCAN/J1939/ODB2 connector, Battery backup is not required; Temperaturerange: 0° C. to +55° C.

Additional software requirements: Read speed, throttle position and fuelconsumption from truck's computer using CAN/J1939/ODB2/J1939; watchdogdriver to reboot the system in case of crash; support for DCAN Driver inRDK; connect the available GPS module to serial port; Module to: readlatitude and longitude and measure GPS Strength; read TemperatureSensor, EEPROM and Magnometer using 12C; support for SSH and SCP;upgrade kernel and file system from remote server; BSP shall be in NANDwith UBIFS file format; Support triggers from below points and supportlogging based on triggers: Accelerometer, Speed (From DCAN Bus), 4 GPIOs(Note: Logging mechanism is described in Phase 1 software SOW.pdf); Ontrigger, capture MP4 video and take JPEG snapshot; If battery is runningout, load trigger files to the server is Wi-Fi connectivity isavailable; Use GIT for version control; Develop a command-line based“Video Capture” application which does the following: Capture 8 audioand video (D1) channels from TVP5158; Encode video and audio data inH264 HP and AAC respectively. Encoder shall support variable bit-rate,fps and GOP size; Multiplex the data using FFMPEG and store it in DDR inMP4 format; At every 2-3600 sec, store the MP4 file in SD card; Videoframe-rate: 1-29.97 fps; Variable GOP as per support in RDK; VideoEncode bit-rate: 100 Kbit/sec to 2 Mbits/sec; Audio bit-rate: 4 kb/secto 128 kb/sec; MP4 file duration: 2-3600 sec; Remote server IP; How manychannels to be recorded; GPS location of the remote servers; Pass theconfigurations as command-line parameter to script/executable; If localstorage (e.g., SD card) is full, overwrite oldest day/hour directory anddelete it.

It will be appreciated that variations of the above-disclosed and otherfeatures and functions, or alternatives thereof, may be desirablycombined into many other different systems or applications. Furthermore,various presently unforeseen or unanticipated alternatives,modifications, variations or improvements therein may be subsequentlymade by those skilled in the art which are also intended to beencompassed by the following claims.

1.-20. (canceled)
 21. A vehicle activity information system onboard avehicle, the system comprising: at least one processor; and memorycommunicatively coupled to the at least one processor, the memorystoring instructions which, when executed by the at least one processor,cause the at least one processor to perform operations comprising:performing real-time analysis of sensor data received from at least onesensor device on the vehicle, the analysis to determine that a triggerevent is occurring; in response to determining that the trigger event isoccurring based on the real-time analysis of the sensor data, accessingvideo data that is captured, by at least one camera on the vehicle,during a period of time that includes the trigger event; determininginformation that includes a portion of the sensor data, wherein theinformation is determined based on one or more rules that indicate, fora particular type of the trigger event, the information to be providedfor performance evaluation; and storing the information, the video data,and a description of the trigger event in the memory.
 22. The vehicleactivity information system of claim 21, wherein the period of timeincludes at least one of a first period of time before the trigger eventand a second period of time after the trigger event.
 23. The vehicleactivity information system of claim 21, wherein the at least one cameraincludes one or more of: at least one interior camera positioned tocapture an interior view of the vehicle; and at least one exteriorcamera positioned to capture an exterior view from the vehicle.
 24. Thevehicle activity information system of claim 21, wherein the informationfurther includes audio data that is captured by at least one microphoneduring the period of time that includes the trigger event.
 25. Thevehicle activity information system of claim 21, wherein the informationis transmitted from a vehicle activity information unit to a computingdevice that is remote from the vehicle using a cellular antenna that iscommunicatively coupled to the vehicle activity information unit. 26.The vehicle activity information system of claim 21, wherein theinformation is transmitted to a computing device that is remote from thevehicle through a portable computing device that communicates over atleast one wireless network connection.
 27. The vehicle activityinformation system of claim 21, wherein the operations further comprise:analyzing the information, in real time with respect to the triggerevent, to identify at least one category of driving event based on theinformation; and sending a notification relating to the at least onecategory of driving event.
 28. The vehicle activity information systemof claim 21, wherein the operations further comprise analyzing theinformation to identify at least one area of driver behavior for use indetermining performance data associated with a driver of the vehicle.29. The vehicle activity information system of claim 21, wherein thetrigger event includes one or more of: running a red light; tailgatinganother vehicle; being tailgated by another vehicle; exceeding a speedlimit at a location of the vehicle; and an acceleration exceeding athreshold.
 30. The vehicle activity information system of claim 21,wherein the operations further comprise analyzing the information todetermine a driver behavior score that is included in performance dataassociated with a driver of the vehicle.
 31. The vehicle activityinformation system of claim 21, wherein the information is determinedbased at least partly on one or more rules that indicate, for aparticular type of the trigger event, the information to be provided bya vehicle activity information unit.
 32. The vehicle activityinformation system of claim 21, wherein the information includes one ormore of: driver information describing a driver of the vehicle; andvehicle information describing the vehicle.
 33. The vehicle activityinformation system of claim 21, wherein the operations comprisetransmitting at least one message over at least one network to acomputing device that is remote from the vehicle, wherein the at leastone message conveys data that includes the information, the video data,and the description of the trigger event.
 34. The vehicle activityinformation system of claim 33, wherein the data is arranged to bepresented through a user interface of the computing device.
 35. Thevehicle activity information system of claim 21, wherein the video datais video data of at least one of an exterior of the vehicle or aninterior of the vehicle.
 36. The vehicle activity information system ofclaim 21, wherein the video data is video data of a scene that includesat least a portion of a driver of the vehicle.
 37. Acomputer-implemented method performed by at least one processor, themethod comprising: performing real-time analysis of sensor data receivedfrom at least one sensor device on a vehicle, the analysis to determinethat a trigger event is occurring; in response to determining that thetrigger event is occurring based on the real-time analysis of the sensordata, accessing video data that is captured, by at least one camera onthe vehicle, during a period of time that includes the trigger event;determining information that includes a portion of the sensor data,wherein the information is determined based on one or more rules thatindicate, for a particular type of the trigger event, the information tobe provided for performance evaluation; and storing, by the at least oneprocessor, the information, the video data, and a description of thetrigger event in memory.
 38. The method of claim 37, further comprising:analyzing the information, in real time with respect to the triggerevent, to identify at least one category of driving event based on theinformation; and sending a notification relating to the at least onecategory of driving event.
 39. The method of claim 37, furthercomprising: analyzing the information to identify at least one area ofdriver behavior for use in determining performance data associated witha driver of the vehicle.
 40. One or more non-transitory computerreadable storage media storing instructions which, when executed by atleast one processor, cause the at least one processor to performoperations comprising: performing real-time analysis of sensor datareceived from at least one sensor device on a vehicle, the analysis todetermine that a trigger event is occurring; in response to determiningthat the trigger event is occurring based on the real-time analysis ofthe sensor data, accessing video data that is captured, by at least onecamera on the vehicle, during a period of time that includes the triggerevent; determining information that includes a portion of the sensordata, wherein the information is determined based on one or more rulesthat indicate, for a particular type of the trigger event, theinformation to be provided for performance evaluation; and storing theinformation, the video data, and a description of the trigger event inmemory.